Goto

Collaborating Authors

 Monrovia


Learning to Trust Your Feelings: Leveraging Self-awareness in LLMs for Hallucination Mitigation

Liang, Yuxin, Song, Zhuoyang, Wang, Hao, Zhang, Jiaxing

arXiv.org Artificial Intelligence

We evaluate the ability of Large Language Models (LLMs) to discern and express their internal knowledge state, a key factor in countering factual hallucination and ensuring reliable application of LLMs. We observe a robust self-awareness of internal knowledge state in LLMs, evidenced by over 85% accuracy in knowledge probing. However, LLMs often fail to express their internal knowledge during generation, leading to factual hallucinations. We develop an automated hallucination annotation tool, Dreamcatcher, which merges knowledge probing and consistency checking methods to rank factual preference data. Using knowledge preference as reward, We propose a Reinforcement Learning from Knowledge Feedback (RLKF) training framework, leveraging reinforcement learning to enhance the factuality and honesty of LLMs. Our experiments across multiple models show that RLKF training effectively enhances the ability of models to utilize their internal knowledge state, boosting performance in a variety of knowledge-based and honesty-related tasks.


230 Delta Passengers Flew With Bomb-Loaded Drone Onboard, AeroVironment Sued

International Business Times

In a lawsuit filed last month and unveiled Thursday, United States defense contractor and drone-maker company AeroVironment was sued by one of the its ex-employees, who claimed he and his colleagues were fired for reporting an incident that violated commercial flight laws. Former programs chief of AeroVironment Mark Anderson claimed in the wrongful termination lawsuit, filed April 18 with the California Superior Court, an unidentified employee of the company traveled from Salt Lake City to Los Angeles in April 2015 on a Delta Air Lines commercial flight with an explosive-laden drone in a carry-on bag. The flight was carrying 230 passengers at the time. It was unclear how the employee managed to take bomb-loaded drone past Transportation Security Administration (TSA) agents before getting on the flight. TSA has an extensive list of items that are banned on commercial flights, be in carry-on or check-in luggage.


Drone maker accused of covering up bomb in bag on Delta flight, going after whistleblower

The Japan Times

NEW YORK – AeroVironment Inc. was accused of trying to conceal that employees transported a drone rigged with explosives on a commercial flight and retaliating against a manager who told the government. In April 2015, AeroVironment workers traveled to Los Angeles from Salt Lake City on a Delta Air Lines Inc. There were about 230 civilian passengers aboard, the lawsuit states. The plaintiff, Mark Anderson, who oversaw security for the drone-maker's top-secret government programs, learned of the incident in May 2015, according to the complaint. After reporting it to the U.S. Department of Defense, he was reprimanded, stripped of his responsibilities and ultimately fired without severance, Anderson alleges.


Brain Chip Gives Drone a Sense of Déjà Vu

#artificialintelligence

There isn't much space between your ears, but what's in there can do many things that a computer of the same size never could. Your brain is also vastly more energy efficient at interpreting the world visually or understanding speech than any computer system. That's why academic and corporate labs have been experimenting with "neuromorphic" chips modeled on features seen in brains. These chips have networks of "neurons" that communicate in spikes of electricity (see "Thinking in Silicon"). They can be significantly more energy-efficient than conventional chips, and some can even automatically reprogram themselves to learn new skills.


Inspector gadget: how smart devices are outsmarting criminals

The Guardian

Richard Dabate told police a masked intruder assaulted him and killed his wife in their Connecticut home. His wife's Fitbit told another story and Dabate was charged with the murder. James Bates said an acquaintance accidentally drowned in his hot tub in Arkansas. Detectives suspected foul play and obtained data from Bates's Amazon Echo device. Bates was charged with murder.